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Abstract: The Daya Bay experiment measures sin 2 20\^ using functionally identical antineutrino 
detectors located at distances of 300 to 2000 meters from the Daya Bay nuclear power complex. 
Each detector consists of three nested fluid volumes surrounded by photomultiplier tubes. These 
volumes are coupled to overflow tanks on top of the detector to allow for thermal expansion of 
the liquid. Antineutrinos are detected through the inverse beta decay reaction on the proton-rich 
scintillator target. A precise and continuous measurement of the detector's central target mass is 
achieved by monitoring the the fluid level in the overflow tanks with cameras and ultrasonic and 
capacitive sensors. In addition, the monitoring system records detector temperature and levelness 
at multiple positions. This monitoring information allows the precise determination of the detec- 
tors' effective number of target protons during data taking. We present the design, calibration, 
installation and in-situ tests of the Daya Bay real-time antineutrino detector monitoring sensors 
and readout electronics. 

Keywords: Detector design and construction technologies and materials; Detector control 
systems; Real-time monitoring; Liquid detectors. 
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Introduction 





The goal of the Daya Bay reactor neutrino experiment is to make a measurement of the neutrino 
mixing angle sin 2 20i3 to a precision of 0.01 at 90% confidence within three years of running flU]- 
The experiment has already released its first measurement of sin 2 2 613 [0], with improved results to 
follow. Daya Bay is one of a new generation of reactor antineutrino disappearance experiments with 
near and far detector pairs located at kilometer- scale baselines from large nuclear power complexes. 
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The experiment consists of eight antineutrino detectors (ADs) installed or under construction at 
three locations near the six-reactor Guangdong Nuclear Power Plant complex, located near Hong 
Kong and Shenzhen, China. The site layout is shown in Figure [I]. An accurate measurement of 
013 is of great importance to the particle physics community. Its value constrains many models of 
electroweak- sector physics and, prior to the first results from Daya Bay, had not been measured 
with high precision. Daya Bay's first experimental results [0, 0] represent major progress toward 
the experiment's long-term goals and are a significant milestone in neutrino physics. 

Like many other neutrino experiments, the Daya Bay antineutrino detectors (ADs) rely on the 
inverse beta-decay (IBD) reaction to detect antineutrinos: 

+ p -> e + + n. 

The basic IBD reaction has an energy threshold of 1.806 MeV 0]; detectors using the IBD reaction 
are not sensitive to antineutrinos with energies below this threshold. The IBD cross-section is about 
10~ 42 cm 2 at Ey = 5 MeV 0], necessitating a very sensitive detector. IBD on free protons is an 
especially desirable reaction for detector use as its signature is both clean and distinctive. The 
positron released during the event annihilates quickly on a detector electron, producing annihilation 
radiation; this is the "prompt signal" of an IBD event. The released neutron can also be detected if 
additional target nuclei that have both a high neutron capture cross-section and emit a clean energy 
signal on neutron capture are present in the detector. Natural gadolinium, containing 157 Gd and 
155 Gd, is used for this purpose in the Daya Bay detectors. Both nuclei have very large neutron 
capture cross-sections and clean neutron capture signatures. The photons released following a 
neutron capturing on Gd in the detector form the "delayed signal" of an IBD event. This combination 
of prompt and delayed signals is very distinctive and easy to distinguish from background, making 
a practically- sized antineutrino detector possible to build. 

This paper discusses the instrumentation located within the Daya Bay antineutrino detectors. 
The target mass monitoring systems, discussed in section £|, track changes in the target mass of 
the ADs in situ and in real time during physics data collection. An accurate determination of the 
target mass is critical to the analysis of data from an antineutrino detector, as the expected IBD 
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Figure 1. Site layout of the Daya Bay Reactor Neutrino Experiment. Six reactor cores are shown, along with 
eight locations for antineutrino detectors. 
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(a) A cross-section of a filled detector, taken through the (b) Close-in section of the detector and overflow tanks, 



Figure 2. Overview drawings of a Day a Bay antineutrino detector, showing the nested liquid volumes and 
locations of instrumentation and key reference points. The stainless steel vessel of each AD is 5 meters 
in diameter and 5 meters tall. Colors distinguish the different liquid regions: gadolinium-doped liquid 
scintillator (GdLS) is shown in green, plain liquid scintillator (LS) in red, and mineral oil (MO) in blue. 

event rate is proportional to the number of target protons in the detector. Additional instrumentation, 
discussed in section 0, monitors the general health and stability of the detectors. 

2. Antineutrino detector design 

The Day a Bay antineutrino detector (AD) design shown in Figure @ has been optimized for detecting 
antineutrinos via inverse beta decay (IBD) events. It consists of three nested volumes, with two 
acrylic vessels containing the inner liquids. The innermost volume contains approximately 20 tons 
of gadolinium-doped organic liquid scintillator ("GdLS"), serving as the IBD target for antineutrino 
capture. The liquid scintillator is primarily linear alkyl benzene (LAB). Hydrogen atoms in the 
LAB are the primary targets for antineutrino capture. The middle region contains about 20 tons 
of unloaded scintillator (the "LS volume") acting as a gamma catcher, ensuring that high-energy 
photons produced in the target volume are reliably converted to scintillation light. The outer volume, 
filled with about 36 tons of inert mineral oil (MO), provides a buffer between the photomultiplier 
tubes (PMTs) and the scintillator, improving PMT light collection from the target region and 
shielding the scintillating liquids from the radioactivity of the PMT materials. Above the main 
detector volumes are overflow tanks, shown in Figure 0, which provide space for thermal expansion 
of the detector liquids. More information on the detector design can be found in [0], on the acrylic 
vessels in [0], and on the scintillator properties and production in [0, 0]. 

The detector design makes predicting the expected event rate from the antineutrino flux straight- 
forward. The three distinct volumes, physically separated with transparent acrylic walls, eliminate 
the need for fiducial volume cuts, reducing cut uncertainty and maximizing detection efficiency. 
The target volume, doped with gadolinium, is the only region that contributes meaningfully to the 
measured IBD event rate [HI], and so the number of IBD targets in the target volume directly deter- 
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Figure 3. A close-up view of the central and mineral oil overflow tanks, showing the two nested central 
overflow tanks and the liquid communication between the overflow tanks and the main detector volume. 
Mineral oil enters its overflow tanks through holes in the vessel lid. GdLS enters the inner central overflow 
tank through a bellows that passes through the middle of the central calibration port connecting the inner 
volumes to the central overflow tank. LS occupies the exterior portion of the calibration port tube, connecting 
to the outer central overflow tank. 

mines the predicted event rate. 1 Only free protons (hydrogen atoms) are useful IBD targets: while 
antineutrinos do initiate IBD reactions on protons bound in nuclei, the produced neutron generally 
is still bound and cannot be easily detected, and the positron and photon signals are difficult to 
distinguish from accidental backgrounds. The free proton count in the target is directly proportional 
to the mass of liquid. Chemical analysis of the target liquid measures the carbon-to-hydrogen ratio, 
which is used together with the target mass to determine the total number of target protons in the 
detector. 

2.1 Overflow tanks 

The Daya Bay ADs are subjected to variations in temperature and external pressure during their 
construction and deployment. A completely sealed detector would be unable to tolerate any changes 
in external conditions; as the detector liquids expanded or contracted due to thermal changes, the 
resulting pressure differentials and stresses in the acrylic vessels could damage or destroy the 
detector. To avoid this problem, each detector volume has one or more overflow tanks located on 
top of the detector, as shown in Figures @, 0, and f|. Each overflow tank is directly connected with 
the main volume for that liquid type; during detector filling the liquids are filled until the overflow 
tanks are partly full. The excess fluid capacity provided by the overflow tanks ensures that the main 
detector volumes are always completely full of liquid. A cover gas system supplies a continuous 
flow of dry nitrogen gas to the empty area of the overflow tanks, maintaining a stable, oxygen-free 
environment for the liquid scintillator. 

Geometrical spill-in and spill-out effects, from IBD events occurring at the edge of the GdLS region, are accounted 
for accurately using Monte Carlo simulations 0, §5.5]. They can affect the event rate by up to 5% [0]. 
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The range of temperatures that the overflow tanks can buffer against is limited. During detector 
filling, the overflow volumes are filled to approximately one-third of maximum capacity, giving an 
operational temperature range of 23~^°C for the filled detectors. The instrumentation described 
in this paper continuously monitors the levels and temperatures of the fluids in all overflow tanks, 
ensuring that we remain within the operational range of the detector at all times. 

3. Stability and monitoring requirements 

The design goals of the Daya Bay experiment QE §3.2] specify a baseline target mass uncertainty 
of 0.2% (2000 ppm) and goal target mass uncertainty of 0.02% (200 ppm) on a nominal target 
mass of 20,000 kg. This requirement corresponds to a baseline uncertainty of 40 kg in the nominal 
target mass and goal uncertainty of 4 kg. The detector filling system was designed to surpass the 
goal uncertainty, and the target mass monitoring system described in this paper must be able to 
match this accuracy goal in order to track longer-term detector changes. Given the central overflow 
tank diameter of 1220 mm and GdLS density of approximately 860 g/L, a 4 kg uncertainty on 
overflow volume mass corresponds to about a 4 mm uncertainty on the overflow tank liquid level. 
Sensors were chosen with specified uncertainties significantly smaller than this level, minimizing 
the contribution to the total target mass uncertainty from the overflow tank monitoring. 

In practice, after sensor calibrations and accounting for overflow tank geometry uncertainties 
and overall detector tilt uncertainties, we achieved a total overflow tank mass uncertainty of 2.2 kg, 
corresponding to 0.01 1% of the nominal target mass (1 10 ppm). 

4. Liquid level monitoring instrumentation 

Three separate systems monitor the liquid height in the detector overflow tanks, as pictured in 
Figure f|. The two central overflow tanks are each instrumented with an ultrasonic liquid level 
sensor and a capacitive liquid level sensor. In addition, cameras in the off-center calibration ports 
monitor the GdLS and LS liquid levels. One of the two mineral oil overflow tanks contains a 
capacitive liquid level sensor. The GdLS and LS overflow tanks each have two independent sensors 
measuring the current liquid level to provide redundancy in the event of a sensor failure. The 
mineral oil level is less critical and is only monitored by a single sensor. The monitoring cameras 
provide a cross-check against potential long-term drift in the GdLS and LS sensors. 

4.1 Ultrasonic level sensors 

The ultrasonic liquid level sensors, which measure the distance from the sensor to the target by 
timing the echo of an ultrasonic pulse, are commercial Senix Corporation ToughSonic TSPC-30S1 
distance sensors ED- They are non-contact sensors, which is ideal for minimizing disruptions to the 
scintillator and alleviating materials compatibility concerns. As the fluid level in the overflow tank 
rises, the distance measured by the ultrasonic sensor decreases linearly, proportional to the increase 
in fluid height. Two sensors are located in each central overflow tank, one in the GdLS volume 
and one in the LS volume. As shown in Figure ^|, they are mounted horizontally on the top of the 
overflow tank lid, with the ultrasound beam directed downwards by a flat acrylic reflector located in 
the mount. This arrangement was necessitated by space limitations; we found that the addition of 
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(a) Top view of the central overflow tanks, showing the 
mounting locations of the sensors and the support struc- 
ture of the tanks. 



(b) A central overflow tank lid shown at the end of assem- 
bly, with all instrumentation installed. (Note that the 
detector 0° axis faces the camera in this image.) 




(c) Ultrasonic liquid level sensor. 



(d) Temperature (e) PTFE capacitive (f) Two-axis inclinometer, 
sensor. liquid level sensor. 




(g) A fully instrumented mineral oil overflow tank. 

Figure 4. Instrumentation and layout of the overflow tanks. Top row: layout of the central overflow tank, 
containing GdLS and LS. Center row: central overflow tank sensors. Bottom: mineral oil overflow tank. 
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Figure 5. An ultrasonic distance sensor shown mounted with rear light baffle on an overflow tank during 
detector assembly. The acrylic reflector is visible at left. (See also Figure |lla| .) 

the reflector caused no discernible change in the performance of the sensor. Figure || also shows a 
light baffle on the back of the sensor, needed to block light from the sensor's rear status LEDs from 
reaching the detector PMTs. 

As described in section |Oi each ultrasonic sensor was individually calibrated. After calibra- 
tion, the ultrasonic sensors are the most accurate liquid level sensors, and are our primary liquid 
height reference. 

4.2 Capacitive level sensors 

The three capacitive liquid level sensors, provided by Gill Sensors [@], are customized versions of 
automotive fuel tank sensors. They consist of two concentric cylinders mounted vertically in the 
liquid tanks as shown in Figures @ and The volume between the cylinders is open to the liquid, 
and as the tank level rises this area fills in with liquid. The dielectric properties of the liquid cause 
a change in the capacitance between the two cylinders, which is read out by instrumentation in the 
top of the sensor. The sensor outputs a value in counts, representing the fraction of the sensor that 
is immersed in liquid, with as the minimum value. Nominally a 10-bit ADC is used, giving a 
resolution of 1024 counts over the full range of the sensor. In practice, we observed sensor readings 
of 1050 counts or more, suggesting a more complicated signal processing scheme inside the sensor. 
Each sensor was individually calibrated as described in section $72j. 

There are two types of capacitive sensors in each detector. One mineral oil overflow tank per 
detector contains a single commercially available stainless steel R-Series sensor, shown in Figure |5a|. 
Its only customization is a factory calibration to the dielectric properties of mineral oil. Stainless 
steel is not suitable for contact with gadolinium-doped scintillator, so the GdLS and LS volumes 
in the central overflow tank use custom M-Series sensors from Gill, shown in Figure |55|. The 
only wetted material in these sensors is chemically inert polytetrafluoroethylene (PTFE). Ordinary 
white PTFE makes up the head of the sensor, enclosing the readout electronics, while conductive 
carbon-impregnated black PTFE makes up the capacitive body of the sensor. Both varieties of 
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(a) A stainless steel capacitive liquid level sensor, located (b) A PTFE capacitive liquid level sensor, located in the 
in a mineral oil overflow tank. central overflow tank. 

Figure 6. The two styles of capacitive liquid level sensor, shown mounted during detector assembly. 



PTFE are chemically compatible with the Daya Bay liquid scintillator over long periods of time. 
These sensors were provided with a factory calibration for linear alkyl benzene. 

The factory calibrations of all sensors were supplemented with a laboratory calibration, de- 
scribed in section In practice, the capacitive sensors have coarser resolution and are not as 
reproducible as the ultrasonic sensors, so they are used as secondary sensors in the event that an 
ultrasonic sensor fails. They also have the advantage of being insensitive to the gas composition 
in the overflow volumes, since they do not depend on the speed of sound as the ultrasonic sensors 
do. Along with the off-center cameras, they provide a cross-check on the ultrasonic sensor data, 
ensuring the ultrasonic sensor response is not changing over time. 

4.3 Off-center cameras 

There are two camera systems located on the detector lid to monitor the GdLS and LS liquid levels. 
As shown in Figure 0, they are located in the off-axis calibration ports of the detector, and view the 
liquid level in the calibration tubes. Figure shows an overview and picture of the system. Sample 
images from the cameras are shown in Figure || A ruled scale placed between the cameras and 
the calibration tubes provides a reference scale for tracking fluid level changes. This enables the 
cameras to be used as a cross-check against drifts of the other sensors. The position of the camera 
elements and calibration tubes was surveyed during installation as part of the global detector survey, 
so the relative positions of the camera and visible sections of the calibration tubes are known to 
millimeter accuracy. 

Infrared-sensitive cameras were chosen with the goal of being able to run the level monitoring 
system during detector operation, without interference with the detector PMTs. The cameras 
are model Watec WAT-902H2 Supreme, equipped with a 380-kilopixel monochromatic infrared- 
sensitive CCD sensor. Illumination for each camera is provided by an array of infrared LEDs behind 
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(a) Model view of the off-center camera system. (b) An assembled off-center camera system in AD8. 



Figure 7. Images of the off-center camera systems. There are two cameras in each detector to monitor the 
GdLS and LS liquid levels at the off-center calibration ports. See also Figures Q and 




(a) Off-center camera image of the GdLS level in AD3. (b) Off-center camera image of the LS level in AD3. 
Note that the GdLS calibration tube is straight. Note that the LS calibration tube has beveled sides. 



Figure 8. Sample images taken by the off-center camera system. 

a diffusing screen, facing the camera from behind the calibration tube. The array produces 30 mW of 
infrared illumination at the camera using 300 mW of electrical power. The LED spectrum is peaked 
at 886 nm with some emittance over the range of 800 to 1000 nm. This spectrum overlaps with the 
camera CCD's near-infrared sensitivity, but is beyond the detector PMT sensitivity (Hamamatsu 
R5912 PMT response falls off at 700 nm) and the absorption spectrum of the scintillator, which 
does not extend significantly beyond 400 nm. While dark box tests confirmed that the infrared 
LEDs did not trigger the PMTs, in-situ testing revealed enough of an increase in PMT hit rates (up 
to 30 Hz) that as a precaution the cameras are not operated while the PMTs are in use. The off-axis 
camera systems are thus only operated to cross-check the other liquid sensors when physics data is 
not being collected. 
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5. Additional instrumentation 

5.1 Inclinometers 

Three inclinometers are mounted on the detector lid, in positions shown in Figure Each sensor, 
a Shanghai Zhichuan Electronic Tech Company Ltd. model ZCT245CL-485-HKLN, has a nominal 
accuracy of ±0.05° with a resolution of 0.01° IfTTHl. An inclinometer is pictured in Figure |15a| . The 
sensors measure the absolute tilt of the detector from the local vertical. Each sensor measures the tilt 
of two axes: the deviation of both its local x-axis and its local y-axis from the plane perpendicular to 
the local vertical. All three sensors are mounted with the same x- and y-axis directions to facilitate 
cross-checking between sensors. Three sensors are used so that both global tilts of the entire detector 
and localized lid deformations, such as flexing or deflection, can be resolved. To first order, the 
calculation of the liquid level in the overflow volume assumes the liquid is level; the inclinometer 
data allows us to quantify any deviation from levelness and apply a correction if necessary. 

5.2 Overflow temperature sensors 

The central overflow volumes for both GdLS and LS each contain a single type PtlOO 
platinum resistance thermometer. The sensors, shown in Figure ^a|, were provided by HW Group 
and are DIN class A (accuracy specification ±0.2°C at 25°C). An acrylic mounting well, shown 
in Figure holds each sensor in position and prevents its stainless steel casing from contacting 
the detector liquids. A drop of mineral oil placed in the well creates a good thermal connection 
between the sensor and the acrylic. 

Temperature sensor readout is performed using a HW Group model Temp-485-2xPtl00 readout 
interface lOl. Each detector contains one dual PtlOO readout module mounted on the AD lid that 
reads out both the GdLS and LS overflow tank temperature sensors. The readout module measures 
the resistance of the PtlOO sensor and converts it to a digitized temperature reading with a resolution 




(a) A close-up image of two PtlOO temperature sensors. (b) A temperature sensor installed in its acrylic mount, 
Each sensor is 6.35 mm in diameter. shown during overflow tank assembly. The elbow 

at upper left is the cover gas intake connection. 



Figure 9. The PtlOO temperature sensors (left) and mounted in place (right). A stainless steel case encloses 
each sensor, and a PTFE sleeve protects the junction between the casing and the sensor cable. 
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(a) A mineral oil temper- (b) Overview image of an assembled PMT (c) Model view of the detector, showing the 
ature sensor, mounted support ladder. Three of the four min- back of the PMT ladders enclosed within 
on the PMT support eral oil temperature sensors are visi- the stainless steel vessel. The four mineral 
ladder, with the sensor ble; the fourth is located just beyond oil temperature sensors, circled in yellow, 
tip exposed at bottom. the bottom edge of the image. are visible at center right. 



Figure 10. Images and mounting locations of the mineral oil internal temperature sensors. 

of 0.01°C, much smaller than the quoted overall accuracy of the sensor, ensuring the absence of 
quantization effects. Three- wire connections between the sensor and readout module are employed 
to reduce measurement error from the resistance of the wire leads on the sensor. 

5.3 Internal temperature sensors 

The detector contains four temperature sensors mounted in the mineral oil volume, as shown in 
Figure [T^. They are arranged vertically along one PMT support ladder to measure any temperature 
gradients in the detector resulting from temperature differentials during detector filling or operation. 
They are electrically and mechanically isolated from the ladder by acrylic housings to give a direct 
reading of the mineral oil temperature at that location. Each sensor is a PtlOO platinum resistance 
thermometer, as employed in the overflow tanks. They are connected using a standard four- wire 
connection to a custom-designed readout module that can accurately measure the sensor's resistance 
and resolve small changes in temperature. 

5.4 Internal cameras 

Two internal cameras are located on the outer wall of the detector, as shown in Figure 0. One is 
mounted looking down at the bottom of the target volume, and one is mounted looking up at the top 
of the target volume. Each camera has a remotely controlled LED bank containing both white and 
infrared LEDs to illuminate the detector during camera operation. The internal cameras are used 
extensively during detector filling and then infrequently afterwards for detector inspection. They 
may also be utilized during a future full- volume manual detector calibration. They cannot be used 
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(a) Diagram of the ultrasonic sensor calibration 
stand. The dotted lines show two nominal 
ultrasound paths. The height h is adjustable 
from to ^400 mm. 
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Figure 11. The ultrasonic sensor calibration setup and one calibration result. 



continually during operation, due to interference between the LED light source and the detector 
PMTs. Their construction and operation is described in more detail in lOl. 

6. Sensor calibration 

Each type of sensor measures a different quantity. Some sensors directly measure the quantity 
of interest, while others return a value that must be converted to physically meaningful units: 
millimeters of liquid height for the liquid sensors, degrees Celsius for the temperature sensors, or 
degrees of inclination for the tilt sensors. For many sensors, the conversion between the output 
quantity and useful units was provided by the manufacturer, but in order to meet the precision level 
required in the Daya Bay detectors, we performed laboratory calibrations of all the critical sensors. 

6.1 Ultrasonic liquid level sensors 

The ultrasonic sensors were calibrated in a laboratory environment using the same apparatus dia- 
grammed in Figure |lla| . Each sensor was set up as shown in Figure |3|. The ultrasonic pulse was 
directed out the bottom of the mount onto a target, a flat piece of acrylic. The target was fixed on 
one jaw of an outside Vernier caliper, with the other jaw fixed on a laboratory optical bench. The 
upper jaw could be adjusted over a wide range, from touching the bottom of the sensor mount (h = 
in Figure |lla|) to about 400 mm (15 in) from the bottom of the mount. The target was positioned 
at several points within this range, and the caliper height recorded along with the sensor reading. 
Sample data from one ultrasonic sensor's calibration is shown in Figure |1 lb| . 

Because the distance from the face of the installed ultrasonic sensor to the bottom of the 
overflow tank is difficult to measure accurately with common measuring tools, the ultrasonic sensor 
is used to determine its own zero value. This method also avoids the problem of having to determine 
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Figure 12. Results of the overflow tank geometry and sensor performance cross-check. The largest observed 
deviation from the design geometry is 1.5 L, which provides the ultimate maximum error bound on the 
overflow tank mass determination. 



the offset between the true path length through the calibration apparatus of Figure |lla| and the caliper 
reading. With the sensor installed in its final position in the dry overflow tank, a baseline sensor 
reading was recorded. This reading defines the zero-fluid point for that tank. The calibration 
apparatus height range was chosen so that this point would always lie near the middle of the 
calibrated range. Thus, subsequent changes in the sensor reading caused by increasing fluid level 
can be accurately converted to an increase in fluid height with the calibration data. 

The ultrasonic sensor measurements are especially sensitive to the speed of sound in the 
medium carrying the sound pulses. The calibration described here was performed in ordinary 
laboratory air, while the operating environment for the sensors is dry nitrogen gas. The difference 
between the speed of sound in nitrogen and in air is large enough that a correction was necessary. 
During sensor calibration, we recorded the temperature, pressure, and relative humidity of the 
laboratory air, then calculated the speed of sound using the expression provided by Cramer I [Till, 
with updated absolute humidity formulas from IfFUl. In operation, the speed of sound is calculated 
using the calibration equation of Span et al. for dry nitrogen [H3, §7], incorporating the frequency 
correction of flT3L §4.1.2]. The cover nitrogen gas exchange is slow enough that the temperature 
measured by the liquid temperature sensors of section |5]2| is approximately equal to the cover gas 
temperature. A nominal supply gas pressure of 21 psia is used for calculations. The variation of the 
speed of sound in nitrogen with pressure is small 2 and can be neglected. Overall, the correction due 
to the varying speed of sound is about a 3 mm change in the measured zero point of each overflow 
tank, or about a 1 mm change in the measured operating liquid level. 

As the ultrasonic sensors serve as the primary fluid level reference, an extra cross-check was 
performed. One overflow tank was set up in a laboratory environment and filled with high-purity 
water in 2000 mL increments, taking ultrasonic sensor readings at each step. (The capacitive 
sensors could not be cross-checked during this test, as they respond differently to water than to 
their operating liquids.) This test provided a full-system cross-check on both the response of the 
ultrasonic sensors and the geometry measurements of the overflow tanks. Data from the test is 

2 In dry nitrogen at 22°C, the speed of sound changes by less than 200 ppm over the pressure range from 14 to 21 psia, 
a much larger variation than we expect in the detector cover gas supply pressure. 
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(a) A schematic of the PTFE capacitive liquid 
level sensor calibration stand. The immer- 
sion depth D of the sensor is calculated in 
terms of the spacer height A, stand height B, 
and sensor length C as D = C — (A + B). 



180 



X 160 

DQ 

S 140 
q 

g 120 
£ 

q 100 
tj 

a- 80 
Lj 

o 

~ 60 
cc 

° 40 



— 1 - Dry insertion 

X 2 / ndf 8.627 / 32 

Offset 169.210.2104 
Slope -0.145610.0003299 



— ° — 2 - Wet removal 

X 2 /ndf 31.89/31 
Offset 173.610.2119 
Slope -0.148210.0003444 



- 3 - Wet insertion 



X 2 /ndf 13.53/32 
Offset 172.210.2173 
Slope -0.148810.0003385 



E 



Average of fits 2 and 3 | 




200 



400 



600 



800 1000 
Sensor Reading [counts] 



(b) The results of sensor calibration for PTFE capacitive liquid 
level sensor 15, showing data from, fits to, and residuals 
for each run separately. For the combined fit, the two wet 
calibrations were averaged, excluding the dry calibration. 



Figure 13. The capacitive liquid level sensor calibration stand and one calibration result. 



shown in Figure [T2|. The maximum observed deviation from the predicted liquid level at a specified 
fluid volume was 1.5 mm, which we take as the maximum height uncertainty of the liquid level 
monitoring system. 

6.2 Capacitive liquid level sensors 

The GdLS and LS volume capacitive liquid level sensors were calibrated using the setup shown in 
Figure |13a| . Each sensor was immersed in a beaker of linear alkyl benzene (LAB) in a spill tray. 
The beaker was kept continually full to the brim with LAB, topped off as necessary; liquid spilled 
out of the beaker at the same height, so topping off the LAB until the point where liquid spilled 
out ensured a constant liquid level in the beaker (i.e., dimension B in Figure |13a| remained fixed). 
The sensor height was adjusted by changing the height of spacers, shown in Figure |13a| in red, with 
thickness given by dimension A. Spacer height ranged from a minimum of zero (no spacers, sensor 
bottom flush with support beam) to approximately 160 mm, slightly greater than the total length of 
the sensor barrel, leaving the tip of the sensor suspended over the beaker. The spacers used were 
thin U-shaped aluminum shims for fine adjustments and aluminum tubes for larger adjustments. 

Each sensor was calibrated in three passes. Before the first pass, the sensor was cleaned in pure 
ethanol and left to dry; ethanol and LAB are miscible, so this rinse left the sensor in a clean state. 
The dry sensor was then lowered into the beaker of LAB, decreasing dimension A in Figure |13a| as 
the sensor descended. After reaching the bottom, the sensor was then lifted out during the second 
pass. The beaker was kept continually topped up during this pass to maintain a constant liquid level. 
The third pass repeated the first pass, but with the sensor now fully wetted with LAB. All three 
passes were recorded and analyzed to calibrate the sensor readout. A sample calibration result from 
one sensor is shown in Figure |13tj The final calibration result used the average of the two wetted 
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Figure 14. Calibration data from the overflow temperature sensors installed in ADs 5-8, all of which were 
calibrated together. To better illustrate the sensor behavior, only the deviations from the reference reading 
are shown. The spread in uncalibrated readings of up to 0.4° C is negligible after calibration. 

runs, excluding the dry calibration result. During operation we expect small level changes over long 
time scales, which corresponds more closely to the performance of an already immersed sensor. 

The calibration of the stainless steel mineral oil capacitive level sensors followed a similar 
procedure. A much larger quantity of mineral oil was available, so all nine mineral oil sensors 
were calibrated together in one large tank of oil. The oil level in this tank was directly controlled, 
avoiding the use of spacers or any adjustment of the sensors. Only one run was performed, starting 
with a dry sensor and finishing with a fully immersed sensor. Multiple calibration runs were not 
performed as one run was sufficient to achieve our accuracy goals for mineral oil level monitoring. 

Due to the tolerances of the sensor mounts, the capacitive level sensor calibration alone was not 
enough to establish the absolute liquid level in the central overflow volumes. After each overflow 
volume was filled with liquid to its operating level, the absolute reading from the ultrasonic sensor 
in that volume was used as a cross-reference to establish the overall offset of the capacitive sensor. 
While this approach is not as robust as an absolute determination of the liquid level using only the 
capacitive sensor, it still allows the capacitive sensor to serve as a secondary level monitor, checking 
any drifts of the ultrasonic sensors and providing redundancy in case of sensor failure. 

Cross-referencing is not necessary for the mineral oil sensors, which have an adjustable mount. 
The installation procedure for the mineral oil sensors uses a model capacitive sensor that is 2.0 mm 
longer than the real sensors. The model sensor is installed, the sensor mount is adjusted until the 
bottom of the model sensor just touches the bottom of the mineral oil overflow tank, then the model 
is replaced with the real sensor. This procedure establishes the calibrated sensor reading as the tank 
liquid level minus 2.0 mm. 

6.3 Overflow temperature sensors 

The overflow tank temperature sensors were calibrated in water baths. The PtlOO sensors were 
placed in a water bath along with a NIST-traceable reference thermometer 3 . We performed a 
full-system calibration: each sensor was paired with its electrical readout module channel before 

3 Omega Engineering model HH41 with ON-410-PP temperature probe, serial number 308697, system calibration ID 
009968179. 
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(a) An inclinometer mounted on the central overflow tank, (b) The calibration data from inclinometer 16, showing the 



Figure 15. Images of the inclinometers and a sample of the inclinometer calibration data. 

calibration, and this pairing was maintained at sensor installation. Sensors were calibrated in 
batches. Groups of four or eight PtlOO sensors were placed in the water bath together, comprising 
complete sets of overflow temperature sensors for two or four detectors, respectively. Data was 
first taken at room temperature, then ice was added to the water bath, and several data points were 
taken as the system cooled down to 0°C. The water bath was frequently agitated to reduce thermal 
gradients in the cooling water. Calibration results from a batch of eight sensors calibrated together 
are shown in Figure 0. All sensors exhibited good linearity within and beyond the detector's 
operational temperature range, meeting the requirements of section 

6.4 Inclinometers 

The inclinometers also were calibrated in a laboratory setting before installation. The inclinometers 
are digital sensors and directly report the measured deviation of their x and y axes from the plane 
perpendicular to local gravity. We determined the zero offset of each inclinometer by taking a 
reading on a known-level surface, as checked to within 0.05° using a SPI-Tronic Pro 3600 digital 
level. We then used a custom-fabricated 150-mm sine bar to tilt each axis of each inclinometer 
by a known amount and tabulated the readings. Sample results from this calibration are shown in 
Figure |15tj demonstrating that all sensors tested showed satisfactory zero readings and inclination 
response. 

7. Instrumentation readout 
7.1 Hardware design 

The electrical layout of the main lid sensor system is shown in Figure [T^. The sensors are all 
physically located within the detector volume, which is sealed and leak-tight against the water 
pool surrounding the detector. All sensors are connected through serial interfaces to a readout 
computer, which has a PCI multi-port serial card installed (a Moxa CP-118U, with eight ports 
each independently configurable for RS-232, RS-422, or RS-485 communication). Each detector 
requires four of the eight ports; one readout computer can read out two detectors with one serial card, 



measurement of the sensor's response and zero offset. 
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Figure 16. Electrical block diagram of the lid sensor system. Line color indicates signal type; the boundary 
between the air side of the system and the detector side is shown by a dashed line, with electrical feedthroughs 
in grey. Some power lines shown as single pairs are multiple parallel conductors for improved redundancy 
and increased capacity. All cabling is shielded. 



or four detectors using two cards. The readout software, written in National Instruments Lab VIEW 
8.6. If 1 for compatibility with other detector readout and control systems, polls each sensor every 
two seconds, redundantly recording the data into both a flat log file and the experiment's SQL 
database. The flat log file is easy to use for manual checks or system debugging, while the database 
provides the measured data directly to the experiment's analysis pipeline. A single DC power supply 
with a serial port connection provides a stable, continuously-monitored, remote-controllable power 
source for all sensor systems connected to a readout computer. 

The 50-meter distance between the detector-side interface and the readout computer means 
that conventional serial interfaces, such as USB or RS-232, cannot be used. Instead, differential 
electrical interfaces are used on the main connection between the detector and the readout computer 
for all sensors. Most sensors were available in RS-485 variants. The 2-wire, half-duplex operation 
of RS-485 is well suited to low-speed, low-volume data readouts like our sensors, and is capable 
of line lengths of much longer than 50 meters even in a noisy electrical environment. One common 
RS-485 line services all RS-485 sensors. The line is run directly from the readout computer to 
the fanout board on the detector lid, where it switches to a star topology to connect to each sensor. 
The use of a star topology rather than the preferred daisy chain was necessitated by the practical 
concerns of cable routing. The short lengths of the star branches, one to two meters each, do not 
cause interference issues, as the signal travel time is much smaller than the typical symbol length at 
our data rate of 9600 baud. 

The capacitive liquid level sensors were not available with an RS-485 interface, only the more 
common RS-232. To carry these signals to the readout computer, they are first converted to RS-422, 
a four-wire, full-duplex, differentially- signaled interface, logically compatible with RS-232. The 
communication protocol used by the capacitive sensors requires a full-duplex link, necessitating 
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Figure 17. Electrical block diagram of the off-center camera system. Line color indicates signal type; the 
boundary between the air side of the system and the detector side is shown by a dashed line, with electrical 
feedthroughs in grey. 



the use of RS-422 and a dedicated line for each sensor. The signal converters are situated on the 
electrical distribution board, mounted on the detector lid just outside the sealed central overflow 
volume, and powered by the common power bus. This arrangement limits the length of the less- 
reliable RS-232 link to only a few meters, using RS-422 for the majority of the line length. 

With the exception of the temperature readout, all sensors on the common RS-485 line use 
checksummed communications protocols, such as Modbus/RTU, so each sensor ignores commands 
not directly addressed to it with matching checksums. The HWg-Poseidon protocol used by the 
temperature sensor does not have a checksum IfTlll. We have seen infrequent readout glitches 
caused by the temperature sensor misinterpreting commands to, or responses from, other sensors 
as a request to read out, causing a transient bus conflict that lasts until the temperature sensor stops 
transmitting. Conflicts are rare in practice, but force our readout system and data analysis chain 
to be able to handle a failed reading without complications. The use of a checksummed protocol 
for all sensors, or the use of dedicated per-sensor lines as with the capacitive sensors, would have 
eliminated this issue. 

The electrical layout of the off-center camera system is shown in Figure |T7|. As with the lid 
sensors, each readout system is able to service one pair of detectors, with two cameras per detector. 
The cameras transmit analog PAL video signals back to the readout computer over RG59 coaxial 
cables. A National Instruments PCI-1410 PCI card in the readout computer receives and digitizes 
the video signals. Each PCI-1410 has four analog video inputs. One twisted pair carries 24 V DC 
power to each camera system and the infrared LED array. The power supply is shared between all 
cameras connected to the same readout PC. 

7.2 Long-term detector monitoring 

The overflow monitoring sensors have been operated continuously since the completion of detector 
installation, recording sensor readings once every two seconds. A sample of the data from AD1 
installed at the Day a Bay near site is shown in Figure [TE|. A split camera image from AD3 is shown 
in Figure [T9| together with sensor data. In all detectors, the liquid level sensors show the same 
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Figure 18. Lid sensor monitoring data from AD1 during the first physics run, using data from 24 December 
2011 to 17 February 2012. Overflow tank GdLS, LS, and MO levels are shown on the left scale, with GdLS 
and LS temperatures on the right scale. Data points are hourly averages. 




(a) The GdLS liquid level and temperature in AD3. Arrows (b) A side-by-side image showing GdLS level changes in 
indicate the times the pictures at right were taken. AD3, from 24 Nov 201 1 (left) to 30 Mar 2012 (right). 

Figure 19. GdLS levels in AD3 before, during, and after the first physics run. The camera and the level 
sensor both show the same change of approximately 4 mm. 



behavior as the camera images. Camera images are taken at least once per month during scheduled 
detector calibration periods when physics data is not being collected. 

A long-term laboratory stability test is underway with a full set of sensors, production read- 
out system, and environmental monitor installed on a test bench at the University of Wisconsin- 
Madison. This setup allows us to monitor the sensors for any long-term drift unrelated to the 
behavior of the fluids. The sensors are readily accessible, so if any future drifts in sensor readings 
are observed, both the sensors and the test environment can be investigated to determine the cause. 
We expect to operate this long-term test stand for at least the duration of the first long-term physics 
run at Daya Bay. 
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Figure 20. Overflow sensor data collected during transportation of AD1 from the detector filling hall to 
Experimental Hall 1 on 11 May 2011. Times are Daya Bay local time, GMT +0800. For clarity, the raw 
level sensor readings are displayed without error bars. Inclinometer values shown are the average of all three 
inclinometer readings, zero-corrected to show change from initial state. 

7.3 Monitoring during detector transport 

After assembly and filling, the Daya Bay ADs were transported to their final locations in the exper- 
imental halls. When full, an AD weighs about 110 tons and can only be transported underground 
using an automatic guided vehicle (AGV), a low-profile heavy-lift transport capable of bearing and 
moving the entire load I [Toll. As one check to verify that the ADs were not damaged during transport, 
we ran the liquid level monitoring instrumentation and monitoring cameras during the first transport 
of AD1 to its installed location. A readout PC and supporting instrumentation were mounted in a 
mobile 19-inch rack with an uninterruptible power supply battery system to provide power; this 
rack trailed behind the AGV as it transported AD1 and allowed us to monitor AD1 liquid levels in 
real time during transport. 

The data collected during the transport of AD1 is shown in Figure ^0|. Several notable features 
can be seen in this data. The measured liquid levels in each volume decreased, which we attribute 
to the agitation of the detector dislodging trapped bubbles of gas. The inclinometers show that the 
detector remained level within the expected range during the transport. Based on the stability of 
AD1 during transport, we decided not to monitor future ADs continuously during transportation, 
instead checking their liquid levels before and after transportation. The results have been consistent 
with AD1: we see no overall change except for a decrease in liquid levels associated with the 
release of trapped gas bubbles. We also performed a final top-off of all detector liquids after 
detector transportation, to replace the volume lost when the gas bubbles were released. 

8. Summary 

We present a comprehensive and redundant system of sensors for monitoring the volume, mass, 
and temperatures of the mineral oil (MO), liquid scintillator (LS), and gadolinium-doped liquid 
scintillator (GdLS) inside the Daya Bay antineutrino detectors (ADs). The GdLS and LS fluid levels 
are monitored continuously by ultrasonic and carbon-impregnated PTFE capacitive sensors in the 
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liquid overflow tanks, and are cross-checked by off-center cameras next to the detector calibration 
tubes. The MO fluid level is monitored by a stainless steel capacitive sensor. Two temperature 
probes monitor the GdLS and LS fluids, respectively, and four temperature probes evenly-spaced 
vertically along a photomultiplier tube support ladder read the MO temperature and determine 
the vertical temperature profile of the detectors. In addition to the fluid monitoring sensors, three 
inclinometers monitor the x- and y-axis tilts of the AD, and two internal cameras allow visual 
inspection of the inside of the AD. 

Uncertainty of the target mass inside the detector is potentially one of the largest systematic 
uncertainties on a measurement of sin 2 20i3. This system of sensors monitors the height of the 
target liquid in the overflow tanks to a precision of 1 mm. When combined with the overflow tank 
geometry information, GdLS density measurements, and tilt sensor data, the set of sensors described 
here is able to track detector target mass changes with a maximum uncertainty of 2.2 kg (0.01 1%), 
significantly less than the baseline design goal of 4 kg (0.02%). Minimizing this uncertainty has 
played a key role in reducing the systematic uncertainty of Day a Bay's measurement of sin 2 29\3 ED. 
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